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[57] ABSTRACT 

A reference picture storing section 101 stores reference 
picture data referred in a motion vector estimation. A current 
picture storing section 102 stores a current picture data for 
the motion vector estimation. A motion vector estimating 
section 103 takes matching between the current picture data 
and the reference picture data to estimate a motion vector 
having the minimum difference. A motion vector statistics 
processing section 104 calculates an average value and a 
histogram from each picture of an estimated motion vector. 
A shift vector setting section 105 calculates a shift vector of 
a motion vector search window based on the average value 
and histogram in each of coded pictures. A search window 
designating section 106 designates a motion vector to be 
searched according to the calculated shift vector so as to 
cause the motion vector estimating section 103 to estimate 
the motion vector. 

30 Claims, 8 Drawing Sheets 
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MOTION VECTOR ESTIMATION SYSTEM above-mentioned method In this method, the search win- 
dow is changed over at each block based on a result of the 

BACKGROUND OF THE INVENTION past motioQ vcctor 

The present invention relates to a motion vector estima- FIG. 14 is a block diagram showing the conventional 

tion system which is used for encoding a moving picture. 5 motion vector estimation system. A motion vector estima- 

A motion compensated interframe prediction method tion circuit 301 estimates a motion vector whose a predictive 

using block matching, has been standardized and widely error is the minimum value within the search window 

used as a technology of high-efficiently encoding moving designated by a selector 304, based on input data of the 

picture data. However, since it is necessary to estimate a current picture and reference picture data. The motion vector 

motion vector in order to realize an interframe prediction, a is outputted to a motion compensator which is not shown in 

calculation became a vast amount to search a wide range. As the figure, and inputted to motion vectors memory 302. 

a result, there are the problems that a system scale becomes -ru „, t M „ . <• 

J . . 1 tie motion vector memory 302 stores a motion vector tor 

larger, and that it is difficult to perform a real time process- c 4 . 4 , . ■ 

. B ' v v ooe-framc term so as to output them to a search window 

15 decision circuit 303 as a motion vector of the block which 

J^Z K , ™ be !° ^° Wa *. SyS ' em disclosed to . ^'A; 1 - has the same spatial position as that of the previous frame. 

166684/1989, which aiim to improve an accuracy mmouon The xalch wjndow decision circujt 303 decides a 

estimation with a decrease of a calculation amount. The f . . «■ 

„ . r wuidow of the motion vector in an objective block in the 

system can set an onset value at a center position of a search ~ 

• AC *• * j- present frame corresponding to size and direction of the 

window for motion vector estimation corresponding to one. 9n • • , - <- ™ * 

When the motion vector is detected at an end of the search m ° tl0n vector m th / P rev ' ous fr f me ' ™ e ^^ctor 304 selects 

window, an offset value of the next frame is set to a position and 0Ut P uts 0De of search endows 305 to 307 correspond- 

of the end of the search window. By the shifting the search m S t0 me decided result of the decision circuit 303. The 

window in the manner, the search window of the motion motion vector estimation circuit 301 performs a motion 

vector is apparently expanded. 25 vector estimation according to the selected search window. 

FIG. 13 is a block diagram showing a conventional A of the search windows includes a normal search 

motion vector estimation system. A frame memory 201 window (FIG. 15A), a search window for attaching impor- 

stores reference picture data. For a search of a motion vector, tance to the horizontal direction shown by a border of a solid 

a difference calculating section 203 obtains a difference line (FIG. 15B), a search window for attaching importance 

between an input current picture and a reference picture at 30 to the vertical direction shown by a border of a solid line 

a representative point which is set by a representative point (FIG. 15C), and a search window for attaching importance 

setting section 202 for referring it corresponding to a search to the diagonal direction shown by a border of a solid line 

motion vector and offset values which are respectively set by (FIG. 15D). Alternatively, it is possible to use search win- 

a horizontal offset control section 206 and vertical offset dows which have modified shapes to the normal search 

control section 207. A frame difference adding section 204 35 window (FIG. 16A), such as a search window for attaching 

calculates a total sum of differences between reference and i raporl ance to the horizontal direction shown by a border of 

current pictures, and a minimum value detecting section 205 a ^ Hne (FIG 16B) a for Aiiachi 

estimates a motion vector which represents the minimum { rtance t0 the vertical direction shown b a border of a 

value or the total sum or differences between the pictures, solid line (TIG 16C] 

then it outputs horizontal and vertical motion vector com- 40 • )■ 

ponents. A final motion vector value is calculated by means ^ ^ P r °t> le m resides in that the optimum motion 

of adders 210 and 211 which add offset values to the vector can not be estimated according to the method of 

horizontal and vertical componet values, respectively, the shifting the search window only when the estimated motion 

offset values which are selected by selectors 208 and 209, vector is the specific value. It is impossible to estimate the 

respectively, according to onset designations which are 45 optimum motion vector in the search window because the 

respectively supplied from the horizontal and vertical offset search window can not follow the motion vector in some 

control sections 206 and 207, which will set new offset occurrence of the motion vector. 

values for searching the next motion vector according to the ^ con6 pro blem resides in that the optimum motion 

output of the minimum value detecting section 205. vector caQ not bc estimated accordmg t0 the method of 

Assuming that an offset value of the n-th frame is 8 V(n) 50 changing over the search windows corresponding to the size 

under the observation of only one directional component, an anc j direction of the estimated motion vector. Because this 

offset setting method is set by the equation as follows: method can x]gxA tQe xmh windows only in the specific 

6V(n+i)=bV(n)+a-AV . . . (1). kinds. 

55 The third problem resides in that the optimum motion 

When 6V is a range of search window, a motion vector V vector can nol bc estimated according to the method of 

is estimated in the range as follows: chan&ng over the search window at each of blocks. Because 

-AViv^AV ... (2) often na PP ens to miss a prediction of the search window 

in a boundary section of the motion, 

where a value of a is set as follows: 60 The founh problem resides in that the optiraum molion 

cl-1 if v-av vector can not be estimated according to the method of using 

the motion vector as it is and which is estimated from the 

ot^-i if v=»-av ... (3) immediately before the coded picture. Because a scale of the 

else motion vector does not coincide with each other in any kind 

65 of pictures according to a picture coding method in which a 

Further, there has been well known the method disclosed time interval between a reference picture and a coded picture 

in JP-A-5-328333/1993 as the method different from the changes. 
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SUMMARY OF THE INVENTION 

The objective of the present invention is to solve the 
above-mentioned tasks. 

Moreover, the objective of the invention is to provide the 5 
motion vector estimation system and method capable of 
estimating the optimum motion vector even in the case 
where a limited search window is used. 

Hie objective of the present invention is achieved by the 
motion vector estimation system comprising a motion vector 10 
estimation means for estimating a motion vector having a 
minimum difference between reference picture data and 
current picture data after matching thereof in a predeter- 
mined search window of a motion vector in each of divided 
regions of which a picture is divided into a plurality of 15 
regions in a picture, motion vector statistics processing 
means for calculating a statistics value of detected motion 
vectors in each of the divided regions in the picture, shift 
vector setting means for calculating a shift vector in the 
search window of the motion vector in the picture to be next 2 o 
coded based on the statistics value of the motion vector 
calculated from a past coded picture in which the motion 
vector has been already estimated, and search window 
specification means for specifying motion vectors to be 
searched by the motion vector estimation means according 2 5 
to the calculated shift vector. 

Furthermore, a motion vector estimating method accord- 
ing to the present invention, comprises steps of calculating 
a statistics value of a motion vector such as an average value 
and a histogram of each picture with respect to the motion 30 
vector which is estimated in the picture coded in past, setting 
a shift vector of the search window of the motion vector 
based on the statistics value, and regulating the shift vector 
corresponding to a time interval between reference picture 
and current picture. 35 

According to the present invention, since the search 
window is controlled for each picture based on the statistics 
value of the motion vector at the picture, it is possible to 
predict a range in which the motion vector is estimated, 
thereby enabling the proper estimation of the motion vector. 40 
Further, since the estimated motion vector is directly used as 
the shift vector without a classification of such as a size, it 
is possible to set a shift of the search window with a merit 
of rapid following with the motion and a higher flexibility or 
adaptability. 45 

Though, the motion vector statistics processing means in 
the present invention may calculate the average value or 
histogram as the statistics value. 

Further, the shift vector setting means according to the 
present invention sets as the shift vector; 50 

(1) the average value of the estimation vector, or 

(2) the motion vector representing the most frequent value 
from the histogram, or 

(3) the average value of the maximum value and mini- 55 
mum value for the horizontal and vertical components 

in the motion vector in the manner of in the manner of 
extracting the motion vector detected over a predeter- 
mined frequency from the histogram of the motion 
vector, or 60 

(4) the average value of extracted motion vectors in the 
manner of extracting the motion vector detected over a 
predetermined frequency from the histogram of the 
motion vector. 

The motion vector statistics processing means according 65 
to the present invention individually calculates the statistics 
value of the motion vector of the forward prediction and 
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backward prediction when both the motion vectors in the 
forward prediction and backward prediction are estimated. 

The shift vector setting means according to the present 
invention individually sets the shift vector of the search 
window of the motion vector of the forward prediction and 
backward prediction when both the motion vectors in the 
forward prediction and backward prediction are estimated. 

The shift vector setting means according to the present 
invention sets the shift vector of the search window corre- 
sponding to a proportion of the first and second time 
intervals, in which the first time interval is between the 
reference picture and the picture from which the motion 
vector is estimated, and the second time interval is between 
the reference picture and the picture to which the next shift 
vector is set. 

The shift vector setting means according to the present 
invention may set the value of the time interval according to 
the average value of the time intervals in the case capable of 
using a plurality of reference pictures each having different 
time intervals, may set the value of the time interval accord- 
ing to a selection of one time interval in the case capable of 
using the plurality of the reference pictures, and may set the 
value of the time interval between the reference picture and 
the picture in which the motion vector of an average value 
is estimated, in which the average value is calculated cor- 
responding to a ratio of which the reference picture is 
selected in the case capable of using the plurality of the 
reference pictures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

This and other objects, features and advantages of the 
present invention will become more apparent upon a reading 
of the following detailed description and drawings, in 
which: 

FIG. 1 is a block diagram showing the motion vector 
estimation system according to an embodiment of the 
present invention; 

FIG. 2 is an explanatory view showing a shift of the 
motion vector search window; 

FIG. 3 is an explanatory view showing a histogram of the 
motion vector; 

FIG. 4 is an explanatory view showing a result of a 
threshold processing to the histogram of the motion vector; 

FIG. 5 is a view for explaining a time interval of the 
picture in which the motion vector is estimated; 

FIG. 6 is a view for explaining a time interval of a picture 
In case of a field prediction; 

FIG. 7 is a view for explaining a time interval of a picture 
in case of a field prediction; 

FIG. 8 is a view for explaining a time interval of a picture 
in case of a field prediction; 

FIG. 9 is a view for explaining a time interval of a picture 
in case of a field prediction; 

FIG. 10 a view for explaining a time interval of a picture 
in case of a dual-prime prediction; 

FIG. 11 is a view for explaining a time interval of a picture 
in case of a dual-prime prediction; 

FIG. 12 is a view for explaining an effect of shifting a 
search window; 

FIG. 13 is a block diagram showing the conventional 
motion vector estimation system; 

FIG. 14 is a block diagram showing the conventional 
motion vector estimation system; 

FIGS. 15A-D are views for explaining a search windows 
in the conventional motion vector estimation system; and 
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FIGS. 16A-C are views for explaining a search windows prediction in the standard of MPEG-2 (ISO/I EC1 38 18). At 

in the conventional motion vector estimation system. this time, a weight may be adjusted by a number of all of the 

estimated. For example, when two motion vectors are esti- 

DESCRIPTION OF THE EMBODIMENTS mated from one block, a statistics is calculated with the 

tu "ii u a u a - a * -i u~a- * f *u 5 weight of Vz to each of motion vectors. Alternatively, when 

There will be described in detail an embodiment of the f . . 4 . t , . " 

iL r • ** i_ j j a plurality or motion vectors is estimated in the same 

present invention with reference to the attached drawings. * v . y ^ ^ v w « 

direction, only one motion vector may be an object or the 

FIG. 1 is a block diagram showing a motion vector smislics calculation for the sake of a simplification, 

estimation system according to an embodiment of the Moreover, there is a case where a motion vector is not 

present invention. 10 estmiale d | n processing of one block. Such the condition 

The motion vector estimation system according to this occurs in a case of selecting an intra -coding mode in which 

embodiment comprises, as shown in FTC 1, a reference an intra-frame coding is performed and an interframe pre- 

picture storing section 101, a current picture storing section diction is not performed, for example, in the MPEG-2. In 

102, a motion vector estimating section 103, a motion vector this case, an accumulation and a frequency update of the 

statistics processing section 104, a shift vector setting sec- 15 motion vector is not performed in the statistics calculation, 

tion 105, and a search window specifying section 106. Alternatively, an object of the statistics calculation may be 

FIG. 2 is a view for explaining a shift of a motion vector the value of the motion vector which is estimated as a 

search window. Small circles in FIG. 2 correspond to search motion vector of a non-intra-mode when judging an intra*/ 

points. A normal search window in an example shown in non-intra-mode. 

FIG. 2, is encircled by a dotted line, and a motion vector 20 (Setting a shift vector) 

search is performed in the normal search window of Next, there is described a method of setting a shift vector 

-4^MVx^+3 and -4^MVy^+3. Here, when (2,4) is in the shift vector setting section 105. At first, there is 

specified as a shift vector, the motion vector estimation is described a case of calculating an average value per a picture 

performed in a window of -2^MVx^+5 and 0^MVy^+7, of the motion vector as the motion vector statistics value, 

which is encircled by a solid line in FIG. 2. In this case, the 25 When the average value per the picture is calculated, the 

search is mainly performed with the motion vector from average value is set to the shift vector as it is. Though, when 

lower right section. According to this, the search window is an average calculation is performed by a relative motion 

controlled by providing the shift vector. vector which does not include the shift vector, the average 

(Calculation of statistics value) value is used after converting to a value including the shift 

Then, there will be described a calculation of a statistics 30 vector, 

value in the motion vector statistics processing section 104. Next, there is described a case of a calculation of a 

In this paragraph, there is calculated the statistics such as an histogram per a picture of the estimated motion vector. The 

average value and histogram of the estimated motion vector. histogram represents a frequency of the motion vector which 

In the calculation of the average value, the motion vector is estimated at the motion vector search point in the search 

values are accumulated at each input of the estimated motion 35 window. One of methods of setting the shift vector from the 

vectors. When a processing on one picture is completed, the histogram, is a method of selecting the motion vector having 

accumulation value is divided by a number of the estimated the highest frequency. Since the highest frequency is shown 

motion vector to obtain the average value of the motion at the point of {(MVx\ Mvy')-(-l,0) as the example in FIG. 

vector. At this time, a rounding processing may be per- 3, if (MVx\ Mvy 1 ) is the relative motion vector which does 

formed at the necessary accuracy. 40 not include the shift vector, the motion vector is used after 

In the calculation of the histogram, when each of esti- adding the shift vector thereto. Further, when there are a 

mated motion vector is supplied, an increment for a value of plurality of motion vectors each having the highest 

a frequency is performed corresponding to the vector. When frequency, a centroidal point thereof is set as the shift vector, 

processing of one picture is completed, a frequency of Alternatively, any one thereof is set as the shift vector to 

respective estimated motion vector is determined to obtain 45 simplify processing, for example, from a motion vector 

the histogram. which is initial or last one in a scanning order, or the nearest 

Even though it is necessary to provide a memory means one of the position (0, 0). 

capable of storing an amount of the detectable motion vector There is a method of using the motion vectors each having 

to store occurrence frequency data, the motion vector esti- a frequency more than a predetermined frequency as another 

mation system may count a frequency of quantized repre- 50 method of setting the shift vector from the histogram. For 

sentative value after quantizing a value of the motion vector example, the histogram is processed by a threshold value to 

in order to reduce a memory area. be a binary value. FIG. 4 shows the histogram in FIG. 3 of 

Here, in the case of estimating the motion vectors having motion vectors in which the histogram on or over two of the 

different predicting direction such as the forward prediction frequency is binarized in '1' and the histogram under two of 

and backward prediction, the motion vectors are calculated 55 the frequency is in '0'. After the binarization, an average 

for each of predicting directions. Alternatively, the motion value of the motion vector representing *T is set as the shift 

vector of one of the directions is changed in the opposite vector. In an example shown in FIG. 4, for example, the shift 

direction so as to be standardized with the time interval to mount is set to (-0.928, -0.357). Alternatively, the shift 

the reference picture, so that it is possible to calculate as the vector is set from an average value of the maximum value 

motion vector having the same kind of the predicting 60 and the minimum value of each component of the motion 

direction. vector representing 'V. In this method, since the maximum 

Further, in the statistics calculation, in the case of esti- value of M Vx' is 1, the minimum value of M Vx' is -3, the 

mating a plurality of motion vectors in the same predictive maximum value of MVy' is 1, and the minimum value of 

direction in one block, all of the estimated motion vectors Mvy' is -2 in the example shown in FIG. 4, (-1, -0.5) is the 

are counted. For example, this case includes a case of a field 65 shift vector. 

prediction in a frame structure, a case of 16 by 8 (16x8) Even though there has been described the method of 

prediction in a field structure, or a case of a dual -prime calculating the shift vector by binarizing the histogram in the 
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above description, there may be a method of processing the 
motion vector estimation by using the histogram as the same 
condition as that shown in FIG. 3 in comparison with the 
threshold value of the frequency without the binarization of 
the histogram. Further, there may be a method of setting an 
upper limit value in a frequency record when the histogram 
is made, and making and using the maximum value of the 
histogram over the upper limit value. 

Since there are a plurality of predictive directions, the 
statistics value is calculated about each of the predictive 
directions, and the above-mentioned shift vector is set about 
each of the predictive directions. For example, FIG. 5 is a 
perspective view showing a coding method using a picture 
(P-picture) which performs only a prediction in the forward 
direction, and a picture (B-picture) which can be predicted 
in the bidirection, namely, in the forward and backward 
directions. In the figure, with respect to a picture 2 being the 
B-picture, the forward directional prediction is performed by 
using a picture 1 being the P-picture as a reference picture, 
and the backward directional prediction is performed by 
using a picture 4 being the P-picture as the reference picture. 
At this time, both of the statistics value are calculated with 
respect to the motion vectors which are estimated for the 
forward and backward predictions, respectively. Further, the 
shift vectors of the search window are also set for the 
forward and backward directions, respectively, in order to 
estimate the motion vector. Here, in order to determine the 
search window shift vector in the backward prediction from 
only an estimated result of the forward prediction, a sign of 
the shift vector in the forward prediction is reversed. 
(A adjustment of the shift vector) 

Next, when a time interval between a reference picture 
and the current picture changes in every picture, there is 
described a method of regulating the shift vector corre- 
sponding to the time interval. At first, the description is 
performed by using an example shown in FIG. 5. In this 
example, a P-picture is coded at every three pictures, and a 
B-picture is coded with respect to two pictures between the 
P-pictures. It is assumed that a coding of a picture 1 is now 
completed, and the coding process is then performed in the 
order of picture 4, picture 2, picture 3, picture 7, . . . , and 
so on. In this case, assuming that an interval between 
succeeding two pictures is 1, a motion vector of a P-picture 
on the picture 4 (P4) is the motion vector corresponding to 
3 of the time interval. Further, on a B-picture of the picture 
2 (B2) which is next coded, the motion vector in the forward 
direction has the time interval to be 1, and the motion vector 
in the backward direction has the time interval to be 2. At 
this time, the shift vector for the prediction in the forward 
direction of B2 may be V3 of the shift vector obtained at P4, 
and the shift vector for the prediction in the backward 
direction of B2 may be - 2 A of the shift vector obtained at P4. 
In the same manner, the shift vector for the forward predic- 
tion of B-picture on the picture 3 (B3) may be two times of 
the shift vector for the forward prediction obtained at B2, 
and the shift vector for the backward prediction may be Vi 
of the shift vector for the backward prediction obtained at 
B2. Further, the shift vector for the forward prediction of the 
P-picture on picture 7 (P7) may be ¥2 times of the shift 
vector for the forward prediction obtained at B3. 

Moreover, it is possible to use a prediction of a unit of a 
field in the case of processing an interlaced signal such as 
MPEG-2.In this case, it is sufficient to adjust the picture 
interval of the field. For example, when the interval of the 
P-picture is three frames as shown in FIG. 6, it is supposed 
that the motion vector is estimated from a P-picture of 
picture 4 (P4) in the frame structure. Here, one frame is 



15 



20 



25 



35 



45 



55 



constituted from 2 fields, and two fields of P4 can refer two 
fields of a P-picture of the picture 1 (PI). Therefore, when 
the field prediction is selected, the first field of P4 has the 
time interval 5 and 6 by the referred field, and the second 
field has the time interval 6 and 7. When the frame predic- 
tion is selected, the time interval is 6 by counting as the field 
interval. Further, a condition of the B-picture is he same as 
above, as shown in FIGS. 7 and 8. For example, the forward 
prediction of the B-picture of picture 2 has respective fields 
each having the time interval to be 1 and 2 after referring the 
field of PI. 

Further, when a coding is performed by a field structure, 
the P-picture has a reference relation shown in FIG. 9. That 
is, a picture P7 refers to a picture PI or a picture P2. In the 
same manner, a picture P8 refers to the picture P2 or the 
picture P7. Accordingly, the picture P7 has 5 and 6 of the 
time intervals, and the picture P8 has 1 and 6 of the time 
intervals. The reference relation of the B-picture in the field 
structure is the same as that in the case of coding in the frame 
structure, as has been already shown in FIGS. 7 and 8. 

Moreover, when the B-picture is not used in MPEG-2, it 
is possible to apply a dual prime prediction for performing 
an average prediction between common and opposite pari- 
ties of fields. In this case, the frame structure has 1 and 2, or 
2 and 3, of the time intervals as shown in FIG. 10, and the 
field structure has 1 and 2 of the time intervals as shown in 
FIG. 11. 

As has been described above, also when the field predic- 
tion is used, the prediction uses the time intervals which are 
set as above, calculates a proportion between the time 
interval corresponding to the estimated motion vector and 
the time interval corresponding to the picture to which the 
shift vector is set, and adjusts the shift vector according to 
the proportion. However, since it is possible to use a 
plurality of reference fields each having the different time 
intervals, the statistics are calculated under the consideration 
of the proportion of the selected reference fields. Here, the 
referred field proportion can not be previously obtained in 
the picture from which the motion vector will be estimated. 
Therefore, an average value is set about a plurality of time 
intervals. For example, even though the first field of B2 
shown in FIG. 7 has 1 and 2 of the time intervals corre- 
sponding to the motion vector in the forward direction, the 
average value V2 thereof is supposed to be the time interval. 
Alternatively, for the sake of the simplification, there may be 
provided the method of selecting any of thereof, for 
example, always using the shorter time interval, always 
using the time interval of the same parity field, and the like. 
In the same manner, when the statistics are calculated, it is 
possible to calculate without using the selected field data for 
the sake of the simplification. Also in this case, the time 
interval may be selected from the average value of the 
enabling values or one value in the candidates. For example, 
there is considered the case of the picture P8 which will be 
coded after the picture P7 as shown in FIG. 9. When the time 
interval is taken from an average value of a plurality of 
reference pictures, the shift vector is (l+6)/(6+5) times of 
the shift vector which can be obtained from the motion 
vector statistics of P7. In the same manner, it is possible to 
calculate with respect to other pictures. 

As mentioned above, even though there has been 
described the structure of the time interval for coding the 
P-picture about every three frames, it is possible to obtain 
the same effect in the case of coding by the different 
structure. Furthermore, in the case of the frame skip struc- 
ture in which the time interval from the reference picture 
changes, it can be considered in the same manner. Moreover, 
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even though there is a case in which the picture of an four past pictures. A method of a shift D is the method in 

intraframe coding without performing the motion vector which the shift vector of the succeeding picture is to a center 

estimation, it may be considered with exclusion such the point of the outermost motion vectors after observing the 

picture histograms of the motion vector estimated from the previ- 

Further, in order to eliminate a adjustment based on a time 5 ously coded pictures and extracting the detected motion 

interval, a shift vector before a time adjustment may be vectors havmg a fluency over 15. That is, this method uses 

applied to the picture having the same positional relation avera S e values of maximum and minimum values of the 

after having been stored during several frames. For example, honzontaJ ™« verUcal 100 rom P™ of £ e fi e * raC * d 

in FIG. 5? the shift vector calculated as the result of mo *™ VCCt °^ ly * ° f * ^ E ^ 

t>a . i ^ ,~ _j r>i , i„ ,„ method in which the shift vector of the succeeding coded 

processing P4 is not applied to B2 and B3 and may apply id fe fc tQ be ^ e yfllue of ^ motion * veclors 

to P7 as it is, after storing during several frames. * ^ fr over 15 & after observing the histogram of 

In the same manner, the shift vector calculated as the me mmion veclQr from lhe picture previously 

result of processing B2 may be applied to B5, and the shift codcd In any of mcthods described above, there is an 

vector calculated as the result of processing B3 may be improved effect of the picture quality measured by the S-N 

applied to B6. 15 ratio with respect to the picture having a rapid moving such 

Furthermore, the shift vector is set not only from the as "Bus", "Hockey w } and "Carousel". Though, the method of 

picture coded immediately before setting and data of one Double is that in which the search window is two time of the 

picture before several pictures, but also using data of a normal one, and the search window is not shifted, which has 

plurality of pictures which have been previously coded. For a higher performance but the calculation amount becomes 

example, there may be used a method of setting as new shift 20 four times of the other methods. 

vector an average value of the shift vectors immediately In the case of coding by the field structure, there is shown 

before past n frame/frames (n denotes a positive and integral in FIG. 12 a result of which two time adjustment methods 

number) and the like. apply to me methods of shift A and shift B. At first, the 

At last, the shift value is modified within a range capable method of Adjustment I is a method of regulating the time 

of actually setting. For example, if each of components of 25 interval as the same as that of the frame structure, 

the shift vector is over the maximum value and the minimum Accordingly, this method is that all of the time interval with 

value which can be set, the shift vector is attached to the lhe ^J*™ » W^ed to be a distance of the same 

maximum value or the minimum value. Further, the shift P^ 1 ^ fi ^ ld ; °° the ° ther hand : the method of Adjustment 11 

vector is rounded to the minimum unit such as the pixel unit 15 a method of regulating the time intervals of a plurality of 

to which the shift vector can be set. 30 rcfercn 1 re frames corresponding to the estimated motion 

As described above, the system according to this embodi- vec u tor b ? ^ a / atl ° * h ? h haS t bccn es * maled M "fo- 
ment shifts the position of the search window without as has **** understood from the graph it is possible to 
changing the size of the window. Since the shift vector is set ^prove the picture quality measured by the S-N ratio in all 
corresponding to the statistics value of the motion vector of * he above-mentioned methods. 

which is estimated in the past coded picture/pictures, it is 35 .** sh ° wn in th ? result of * e ^ulation even though the 

possible to properly predict a window from which the picnire has a rapid moving which can not be covered by the 

_ , L a "L-l„ t t i trt -e< - ata „ rrt ™ ar normal search window, the motion vector can be estimated 

motion vector is estimated, and to estimate the proper « . • * i 

motion vector even in the case of using the limited search b * shlftin S lhe search window so as to estimate the optimum 

window. Actually, as the result of applying the search motlOD vec J or > Staining an improved effect of the 

window shifting method of the present embodiment to the 40 P ic ^ re ^ uallt y , m 1 lhe cas * ° f coding under the fixed rate, 

picture coding method of MPEG-2 (ISO/IEC-13813), it is ^ e f ™^ clo * ur f of Japanese Patent apphcation Ser. 

possible to improve a noise to signal (S-N) ratio (SW) I with No ' J*" 13859 * . filed on . Ma * }*> 1997 > lQcludin S 

respect to the picture including a motion which can not be specification claims, drawing and summary are incorpo- 

estimated in the normal search window in comparison with rated herem by reference in its entirety, 

the case where the search window is not shifted. 45 7 hat 15 clauned ls: . . 

FIG. 12 shows a result of the actual simulation. The figure mohon vector estimation system, compnsing: 

is a graph showing an improved amount of the S-N ratio in motion vector estimation means for estimating a motion 

the case where the motion vector search window is shifted vector havin 8 a minimum difference between reference 

when the moving picture is coded to several kinds of P icture data and P lcture data after matching 

pictures, in comparison with the fixed search window of the 50 mereof irj a predetermined search window of a motion 

motion vector. The left side of the graph shows a case of vector m each of K ^ oos of which a P icturc 15 

coding by the frame structure, and the right side of the graph divided into a plurality of regions in a picture; 

shows a case of coding by the field structure, respectively. motion vector statistics processing means for calculating 

There are conditions of the simulation in which the normal a statistics value of detected motion vectors in each of 

search window has the maximum range of -47 through +47 55 tne divided regions in the picture; 

pixels in the horizontal direction and -15 through +15 pixels shift vector setting means for calculating a shift vector in 

in the vertical direction, and a bit rate is 4 Mbit/second. the search window of the motion vector in the picture 

In the case of coding by the frame structure, a method of to be next coded based on the statistics value of the 

a shift A is the method in which the shift vector of the motion vector calculated from a past coded picture in 

succeeding coded picture is to be an average value of the 60 which the motion vector has been already estimated; 

motion vector picture estimated from the previously coded and 

picture. A method of a shift B is the method in which the search window specify means for specification a proposed 

shift vector is to be the average value of the average value motion vector to be estimated by the motion vector 

of the estimated motion vectors in an entire pictures coded estimation means according to the calculated shift 

in past. A method of a shift C is the method in which the shift 65 vector. 

vector of the succeeding picture is to be the average value of 2. The motion vector estimation system of claim 1, 

the average value of the estimated motion vectors in further wherein said motion vector statistics processing means 
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comprises means for calculating an average value of said of using a plurality of reference pictures each having dif- 

motion vectors as said statistics of said motion vectors. ferent time intervals, means for setting a shift vector of a 

3. The motion vector estimation system of claim 2, search window by selecting one of said plurality of time 
wherein said means for calculating said average value of interval to be a value of said time interval. 

motion vector further comprises, in a case of estimating a 5 15. The motion vector estimation system of claim 1, 

plurality of motion vectors each having a predictive direc- wherein said shift vector setting means, in a case of using a 

tion in a divided region, means for adjusting a weight to said plurality of reference pictures each having different time 

estimated motion vector. intervals, means for setting a shift vector of a search 

4. The motion vector estimation system of claim 2, window, after calculating an average value of said time 
wherein said shift vector setting means comprises means for intervals corresponding to a rate in which each of said 
setting said average value of said motion vectors as said shift reference pictures is selected to set said average value as the 
vector - time interval between the reference picture and a picture in 

5. The motion vector estimation system of claim 1, whicn a mot i on vector having said average value, 
wherein said motion vector statistics processing means 16. Amotion vector estimation method appued to moving 
comprises means for calculating a histogram of said motion - cture ^ comprising: 

vectors as said statistics of said motion vectors. 15 , * • 

6. The motion vector estimation system of claim 5, a slep of calculating a statistics value of motion vectors of 

wherein said means for calculating said histogram further each of P ictures ™* res P ect 10 said mollon veclors 

comprises, in a case of estimating a plurality of motion estimated from pictures which are previously coded; 

vectors each having a predictive direction in a divided a step of calculating a shift vector of a search window of 

region, means for adjusting a weight to said estimated 20 a motion vector on a picture which will be coded, based 

motion vector. on said statistics value which is calculated in the 

7. The motion vector estimation system of claim 5, previous step, and 

wherein said shift vector setting means comprises means for a step of designating a search window of said motion 

setting as said shift vector a motion vector having the most vector, based on said shift vector calculated in said step, 

frequent value of said histogram of said motion vectors. 25 17. The motion vector estimation method of claim 16, 

8. The motion vector estimation system of claim 5, wherein said step of calculating said statistics of the motion 
wherein said shift vector setting means comprises means for vector, includes a step of calculating an average value of said 
extracting motion vectors detected more than a predeter- motion vectors as said statistics of said motion vectors, 
mined frequency from said histogram of said motion 18. The motion vector estimation method of claim 17, 
vectors, and for setting said average value of said extracted 30 wherein said step of calculating said average value further 
motion vector as said shift vector. comprises, in a case of estimating a plurality of motion 

9. Tne motion vector estimation system of claim 5, vectors each having a predictive direction in a same divided 
wherein said shift vector setting means comprises means for region, a step of adjusting a weight to said estimated motion 
extracting motion vectors detected more than a predeter- vector. 

mined frequency from said histogram of said motion 35 19. The motion vector estimation method of claim 18, 

vectors, and for setting said average value of maximum wherein said step of calculating said shift vector in said 

values and minimum values in a horizontal and vertical search window comprises a step of setting said average 

directional components of said extracted motion vector as value of said motion vectors as said shift vector, 

said shift vector. 20. The motion vector estimation method of claim 16, 

10. The motion vector estimation system of claim 1, 40 wherein said step of calculating said statistics value of said 
wherein said motion vector statistics processing means motion vector, comprises a step of calculating a histogram of 
comprises, in a case of estimating motion vectors each said motion vectors as said statistics of said motion vectors, 
having different predictive directions, means for individu- 21. The motion vector estimation method of claim 20, 
ally calculating a statistics value of motion vectors in wherein said step of calculating said histogram further 
particular predictive directions in said different predictive 45 comprises, in a case of estimating a plurality of motion 
directions. vectors each having a predictive direction in a same divided 

11. The motion vector estimation system of claim 1, region, a step of adjusting a weight to said estimated motion 
wherein said shift vector setting means comprises, in a case vector. 

of estimating motion vectors in a forward prediction and 22. The motion vector estimation method of claim 20, 

motion vectors in a backward prediction, means for indi- 50 wherein said step of calculating said shift vector in said 

vidually setting shift vectors in each direction of said search window comprises a step of setting as said shift 

forward and backward predictions. vector a motion vector having the most frequent value of 

12. The motion vector estimation system of claim 1, said histogram of said motion vectors. 

wherein said shift vector setting means comprises means for 23. The motion vector estimation method of claim 20, 

setting said shift vector of a search window corresponding to 55 wherein said step of calculating said shift vector in said 

a proportion of a time interval between a reference picture search window comprises a step of extracting motion vec- 

and a picture in which a motion vector is estimated, and a tors detected more than a predetermined frequency from said 

time interval between a reference picture and a picture in histogram of said motion vectors, and a step of setting said 

which a next shift vector will be set. average value of said motion vector as said shift vector. 

13. The motion vector estimation system of claim 1, so 24. The motion vector estimation method of claim 20, 
wherein said shift vector setting means comprises, in a case wherein said step of calculating said shift vector in said 
of using a plurality of reference pictures each having dif- search window comprises a step of extracting motion vec- 
ferent time intervals, means for setting a shift vector of a tors detected more than a predetermined frequency from said 
search window by using an average value of said time histogram of said motion vectors, and a step of setting said 
intervals to be said time interval. 65 average value of maximum values and minimum values in 

14. The motion vector estimation system of claim 1, a horizontal and vertical directional components of said 
wherein said shift vector setting means comprises, in a case motion vector as said shift vector. 
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25. The motion vector estimation method of claim 16, search window comprises, in a case of using a plurality of 
wherein said step of calculating said statistics in said search reference pictures each having different time intervals, a step 
window comprises, in a case of estimating motion vectors of setting a shift vector of a search window by using an 
each having different predictive directions, a step of indi- average value of said time intervals to be said time interval, 
vidually calculating a statistics value of motion vectors in 5 29. The motion vector estimation method of claim 16, 
particular predictive directions in said different predictive where in said step of calculating said shift vector in said 

directions. , , . , . . . search window comprises, in a case of using a plurality of 

26. The motion vector estimation method of claim 16, ^ , , . r , 
wherein said step of calculating said shift vector in said refereace ^ mKS each havin § dlffereDt tme mtervals ' a ste P 
search window comprises, in a case of estimating motion 10 of setting a shift vector of a search window by selecting one 
vectors in a forward prediction and motion vectors in a of said plurality of time interval to be a value of said time 
backward prediction, a step of individually setting shift interval. 

vectors in each direction of said forward and backward 30. The motion vector estimation method of claim 16, 

predictions. wherein said step of calculating shift vector in said search 

27. The motion vector estimation method of claim 16, 15 window further comprises, in a case of using a plurality of 
wherein said step of calculating said shift vector in said reference pictures each having different time intervals, a step 
search window comprises a step of setting said shift vector of calculating an average value of said time intervals cor- 
of a search window corresponding to a proportion of a time responding to a rate in which each of said reference pictures 
interval between a reference picture and a picture in which is selected, a step of setting said average value as the time 
a motion vector is estimated, and a time interval between a 20 interval between the reference picture and a picture in which 
reference picture and a picture in which a next shift vector a motion vector having said average value, and a step of 
will be set. setting a shift vector of a search window. 

28. The motion vector estimation method of claim 16, 

wherein said step of calculating said shift vector in said ***** 
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